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DESCRIPTION 
JTrick playback method for a digital storage medium 
Technical Field 

The present invention relates generally to a method for 
recording and reproducing digital multimedia content such as video and audio 
to flash memory or other digital storage medium, and relates more particularly 
to trick play methods including random access, fast forward, and fast rewind 
10 playback modes. 

Background Art 

£1 

Trick playback modes are achieved with conventional digital 
storage media by dividing the content into sectors of a specific size and then 
J 15 using an address table containing sector addresses and index numbers, time 
codes, content titles, and content encoding unit information. 

Fig. 22 describes how a trick playback mode is implemented 
with conventional digital storage media. Fig. 22 (a) shows the data recording 
structure, and (b) to (f) are various sector address lookup tables recorded 
20 with the data in order to achieve a trick playback mode. More specifically, 
tables (b) to (f) cross reference index numbers, time codes, content titles, 
sequence header numbers (indicating the start of each sequence, that is, the 
content encoding unit), and the first and last sector address of each l-picture 
(a picture encoding type). The content is data compressed in sequential units 
25 using MPEG-1 or other compression encoding technique, then segmented 
into sector units of a specific size for recording to optical disc. A unique sector 
address is assigned to each sector The sectors are further divided into 
blocks. Each block starts with a header containing a synchronization signal, 



common sector address, unique block address, and a parity bit, the header is 
followed by the content data; and the block then ends with an ECC parity 
word for error correction. 

Trick playback modes are achieved with multimedia content 
recorded in this manner as follows. 

It should be noted that playback of compressed content cannot 
start from any desired location. More specifically, playback can only start from 
specific positions, that is, the sequence header. This means that in order to 
randomly access content when the user selects an access point such as the 
beginning of a song, the sector address at the start of the selected content Is 
first determined from table (d) in Fig. 22. Playback then starts from the sector 
address found in table (e) for the sector containing the sequence header 
containing the address closest to the sector address found in table (d). 

If playback positions are defined more precisely, the user can 
use the index numbers to specify where in a song (for example) to start 
playback. In this case the sector address corresponding to the specified index 
number is found from table (b) to start playback. If the user specifies the 
playback start position using a time code, the sector address closest to the 
specified time code is found from table (c), and playback starts from the 
sector address found in table (e) of the sector containing the sequence 
header with an address closest to the sector address found in table (c). Fast- 
forward and fast-reverse play modes are similarly achieved by sequentially 
finding the start and end sector addresses of the independently reproducible 
I-pictures from table (f) and then skipping from l-picture to l-picture to play 
only the I-pictures in the forward or reverse play direction. The methods 
described above are known, for example, from USP 6,002,834, Optical Disk 
Having Table Relating Sector Address and Time and Optical Disk 
Reproducing Apparatus. 



As will be understood from the tables in Fig. 22, the index 
numbers, time codes, sequence headers, and l-pictures are managed using 
sequential numbers in the prior art method described above. This means that 
in order to start playback from 10 seconds into content B, for example, this 
relative time must be converted to a specific value in the continuous time 
code. Because the total playback time of content A is unknown, however, an 
accurate time code for starting playback from 10 seconds into content B 
cannot be determined. 

A further problem arises from the indeterminate length of the I- 
pictures. More specifically, because the l-picture length is variable, it is not 
known how much data must be read in order to skip to the next l-picture in 
fast-forward and fast-reverse play modes. 

Disclosure of Invention 

The present invention is directed to solving the above problems by 
providing a trick playback method for digital storage media used for recording 
and reproducing multimedia content containing compressed digital audio and 
video data. 

A trick play method according to a first aspect of the present 
invention achieves a random access play mode using a digital storage 
medium recording and reproducing multimedia content including compression 
coded digital audio and video data by recording a directory segmenting the 
content into program units, segmenting the content into a plurality of media 
object units, and recording each media object unit as a separate file. The 
digital storage medium also records a program manager file storing a table 
containing an identifier (ID) for each program of recorded content and 
information about the media objects in each program, a media object 
information file storing a table containing playback time information and entry 
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points at a specific time interval for each media object, and a playlist manager 
file containing playlist information including a user-specified playback start 
program ID and the specified playback start time and end time of said 
program. Random access play mode when a user specifies a playback start 
5 program ID and playback start time within said program is achieved by 
reading the playback times in the media object information of the specified 
program sequentially from the beginning of the specified program to detect 
media object k at the user-specified playback start time. The entry point at the 
user-specified playback start time is then detected by subtracting the total 

10 playback time to the immediately preceding media object from the user- 
specified playback start time, and comparing the difference with a time search 
table resolution in the media object information for media object k. Data for 
media object k is then read and supplied to the decoder from the entry frame 
of the media object data unit containing the entry point. The decoder starts 

15 output to the display when decoding advances to the entry point; and 
thereafter media objects are sequentially decoded according to the playlist 
information and program manager file 

A trick play method according to second and third aspects of the 
present invention achieve fast-forward and fast-reverse play modes using a 

20 digital storage medium recording and reproducing multimedia content 
including compression coded digital audio and video data by recording a 
directory segmenting the content into program units, segmenting the content 
into a plurality of media object units, and recording each media object unit as 
a separate file. The digital storage medium also records a program manager 

25 file storing a table containing an identifier (ID) for each program of recorded 
content and information about the media objects in each program; a media 
object information file storing a table containing playback time information and 
entry points at a specific time interval for each media object; a playlist 
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manager file containing playlist information including a user-specified 
playback start program !D and the specified playback start time and end time 
of said program; and a management data file containing a resume marker 
consisting of a program ID for a program where playback was last interrupted 
5 and playback interrupt time where playback was interrupted in the program. 
When the user selects fast-forward play or fast-reverse play, the media object 
information in the program specified by the resume marker is reads in 
't? sequence from the beginning, and the playback lime in the media object 

J; information is sequentially compared with the interrupt time to detect media 

10 object k where the cumulative playback time first exceeds the interrupt time. 
PJ The entry point number is then detected by calculating the difference of the 

p interrupt time specified by the resume marker minus the total playback time to 

II the immediately preceding media object, and dividing this difference by the 

%i time search table resolution in the media object information of media object k. 

15 Entry frame data for the media object data unit corresponding to said entry 
point is then read and supplied to the decoder These steps are then repeated 
to supply entry frame data for the next media object data unit to the decoder if 
fast-forward play is selected, or supply entry frame data for the preceding 
media object data unit to the decoder if fast-reverse play is selected. When 
2 0 fast-forward or fast-reverse play ends, the resume marker is rewritten with the 
program ID of the program at which playback is interrupted and the time in 
said program when playback was interrupted. 

This file configuration and playback sequence enables random 
access playback from any user-selected point in the content, and enables 
25 fast-forward, fast-reverse, and other trick play modes by accurately reading 
only the data required for the selected trick play mode. 

The digital storage media trick playback method according to the 
first and second aspects of this invention enables complicated trick playback 
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modes requested by the user to be easily achieved. 

More particularly, the method according to the first aspect of the 
invention easily starts random access playback from a desired position 
specified by the user. 

5 The method of the second aspect of the invention efficiently 

achieves fast-forward and reverse play modes as specified by the user. 

2 Brief Description of Drawings 

Fig. 1 is a block diagram of the configuration of a digital storage 
^1 10 media recording and playback system according to a preferred embodiment 
of the invention; 

p Fig. 2 shows the directory structure of a digital storage media 

m 

according to a preferred embodiment of the invention; 



Fig. 3 shows an example of the management data file 
15 MGR_DATA in a preferred embodiment of the invention; 

Fig. 4 shows an example of the program manager file 
PRG_MGR in a preferred embodiment of the invention; 

Fig. 5 shows an example of the program information PRG_INFO 
in the program manager file PRG_MGR; 
20 Fig. 6 shows an example of the piaylist manager file PLST_MGR 

in a preferred embodiment of the invention; 

Fig. 7 shows an example of the piaylist information PLST_INFO 
in the piaylist manager file PLST_MGR; 

Fig. 8 shows an example of a media object information file *.MOI 
25 in a preferred embodiment of the invention; 

Fig. 9 shows an example of the media object unit information 
MODU_INFO in a media object information file; 

Fig. 10 shows an example of the recording process in a 
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preferred embodiment of the invention; 

Fig. 11 shows an example of the editing process in a preferred 
embodiment of the invention; 

Fig. 12 shows an example of the playback process using a 
5 playlist in a preferred embodiment of the invention; 

Fig. 13 shows an example of the random playback process in a 
preferred embodiment of the invention; 

Fig. 14 shows an example of the fast-forward/fast-reverse 
playback process in a preferred embodiment of the invention; 
10 Fig. 15 illustrates the playback process; 

Fig. 16 illustrates the fast-forward/fast-reverse playback 

process; 

Fig. 17 shows the relationship between media object data units 
MODU and time search entries TSE; 
15 Fig. 18 IS a flow chart describing the operation for starting 

playback from a playback start time PBT; 

Fig. 19 is a flow chart describing the fast-forward and fast- 
reverse playback operations; 

Fig. 20 is a flow chart for opening the time search table of time 
2 0 search entries TSE for fast-forward play; 

Fig. 21 is a flow chart for opening the time search table of time 
search entries TSE for fast-reverse play; and 

Fig. 22 shows the table structure used to achieve trick playback 
modes with a prior art digital storage media. 

25 

Best Mode for Carrying Out the Invention 

A digital storage media trick playback method according to a 
preferred embodiment of the present invention is described next with 



8 



reference to the accompanying figures. 

'Trick play" as used herein includes the following: reverse 
playback at normal speed; forward and reverse playback at fast-forward 
speed; forward and reverse playback at slow speed, random playback; 
5 jumping; and pause. 

"Fast-forward" means playback in the normal forward direction 
at a speed faster than the normal playback speed, 

"Fast-reverse" means playback in the reverse direction at a 
speed faster than the normal playback speed. 

10 Digital storage media of the present invention include 

semiconductor memory cards such as flash memory, but do not include disk 
or tape media. Digital storage media of this invention are thus static recording 
media not having any moving parts, and do not include driven recording 
media (such as disks and tape) using moving parts. 

1 5 Fig. 1 is a block diagram of a recording and playback system 

achieving various trick playback modes using a digital storage medium 
according to a preferred embodiment of this invention Shown in Fig. 1 are the 
digital storage medium 1 , recording and playback system 2, a camera 3 for 
recording content, a display 4 for presenting content reproduced from the 

20 digital storage medium 1, an input device 5 such as a remote control device 
having a keypad, and a controller 6. Each of these components is connected 
to the recording and playback system 2. Content is captured by the camera 3, 
compressed by the recording and playback system 2 using the MPEG-1 or 
other standard, and recorded to the digital storage medium 1. The stored 

25 content is read from the digital storage medium 1, decompressed by the 
recording and playback system 2, and presented on the display 4. These 
sequences of operations are executed according to commands from the input 
device 5 and controlled by the controller 6. 
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Fig. 2 shows the directory structure of the content and 
management information files written to digital storage media in this 
embodiment of the invention. 

To achieve the trick playback method of this invention, 
5 multimedia content containing video and audio data is recorded by program 
unit as a media object data file MOVnnn.MOD (where nnn is a hexadecimal 
value) in program directory PRGxxx (where xxx is a hexadecimal value), and 
information for the media object data entries is recorded to the media object 
information file MOVnnn.MOI. Still images and text data reproduced at the 
10 same time as the media object data are recorded to PCInnn.JPG and 
TXTnnnTXT files, respectively. If plural video data objects are reproduced at 
the same time, which MOVnnn.MOD are reproduced is also written to the 
scene descriptor data file SCNnnn.SML. 

Management information for the entire program is recorded in 
15 the management data file MGR^DATA. program manager file PRG__MGR and 
playlist manager file PLST_MGR in the management directory MGRJNFO. 

Fig. 3 shows the structure of the management data file 
MGR_DATA. As shown in Fig. 3, the management data file MGR_DATA in 
this preferred embodiment of the invention contains the type DataType, size 
20 DataSize, and version Version of the management data, as well as a 
ResumeMarker recording where playback was stopped if playback is 
interrupted, and user-definable Text Info. 

Fig. 4 shows the structure of the program manager file 
PRG_MGR in this preferred embodiment of the invention. As shown in Fig. 4, 
25 the program manager file PRG_MGR contains the type DataType and size 
DataSize of the program manager, the total program playback time 
PlayBackDuration, the number of program information entries NumPrglnfo, 
and the program information PRG_INFO table (more specifically, an array of 
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PrglnfoTbl[NumPrglnfo] entries). 

Fig. 5 shows the structure of the program information 
PRGJNFO table in the program manager file PRG_MGR. As shown in Fig. 5 
the program information PRG_INFO table contains the program information 
type DataType and size DataSize, the program identification number PrgID 
identifying the specific program (shown in field 51) and the playback time 
Playback Duration (shown in field 52). Also recorded are specific program 
Attributes declaring whether the content is protected and whether scene 
descriptors are used; profile information Profile indicating the encoding 
method used; user-definable text information Textlnfo such as the program 
title or other information; an address RepPos of a scene or program part 
representative of the program content; the number of media objects 
NumRefMoi (shown in field 53) contained in the program; a reference table 
RefMoiTbl (the size of which is assigned by NumRefMoi) containing the 
object ID and playback of each media object and whether there are any 
associated objects; the number of user-definable markers NumMarker that 
the user can set in the program; and a marker location table MarkerTble (the 
size of which is determined by NumMarker). 

Fig. 6 shows the structure of the playlist manager file 
PLST_MGR. As shown in Fig. 6 the playlist manager file PLST__MGR 
contains the file type DataType and size DataSize, the number of user- 
defined playlists NumPlstlnfo, and a table PLSTJNFO containing the playlists 
(specifically, PIstlnfoTbl (the size of which is identified by NumPlstlnfo)). 

Fig. 7 shows the structure of the playlist information PLST__INFO 
in the playlist manager file PLST_MGR. As shown in Fig. 7 the playlist 
information PLST_INFO table contains the data type DataType and size 
DataSize, the list playback time Playback Duration, list attributes Attributes, 
text information Textlnfo, the position of a representative picture RepPos, the 
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number of programs specified in the playlist NumPrglD, playback program 
information (including the program object ID ObjID, playback start time 
StartPos, and playback end time EndPos) (shown in field 71), the number of 
markers NumMarker, and a marker location table MarkerTbl (an array of 
NumMarker values) identifying marker locations by time. 

Fig. 8 shows the structure of the media object information file 
*.MOf in the program directory. As shown in Fig, 8 the media object 
information file *.MOI contains the file type DataType and size DataSize, the 
y media object playback time PlayBackDuration, the character code and other 

J 10 attributes TxtAttr used in the text data, and a time search table type identifier 
inj TstType, Also included if the type identifier TstType value is 1 or 2 are the 

time search table resolution Tstlnterval, the time FrameTime defining the 
playback time of one frame expressed as a fraction, the number of entries 
NumTstEntryl or NumTstEntry2 in the time search table, the number of 
15 information tables NumModui of compression-coded unit media object data 
units MODU that can be reproduced from that position, a media object data 
unit information table MODU_INFO (specifically, ModuiTbl (of size 
NumModui)), the media object data unit MODU number ModuNumber 
corresponding to each entry position, the number of frames EntryFrameDiff 
2 0 from the immediately preceding entry frame to the time search entry (that is, 
to the entry point), and the position (bytes) ModuOffset of the corresponding 
media object data unit. Included if the type identifier TstType value is 3 is the 
FrameTime defining the playback time of one frame expressed as a fraction, 
the size of one packet PacketSize, and the number of frames NumFrame in 
25 one packet. 

Fig. 9 shows the structure of the media object unit information 
MODUJNFO in each media object information file *.M01. As shown in Fig. 9 
this information includes the size EntrySize of the entry frame (the first frame 
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in a media object data unit), the number of frames ModuPbTime in the media 
object data unit, and the size ModuSize of the media object data unit 

Note that a media object data unit is also referred to below as 
simply MODU. 

5 Assume that plural programs, specifically two programs in this 

example, are recorded to the digital storage medium 1 as shown in Fig. 17. 
p Assume further that one program (PRG001) records a children's field day at 

'^i school, and the other program (PRG002) records a picnic. Management 

j^l information relating to the field day program {PRG001) is recorded in program 

"l2 10 information PRG_INF01 in Fig. 5, and management information for the picnic 
W program (PRG002) is recorded in program information PRG_INF02 in Fig. 5. 

p PRG001 is recorded as the program ID to field 51, and the normal playback 

hi 

information for the entire program is recorded to the PlaybackDuration in field 
ii 52 in the field day program information PRG_INF01. The same type of 

■'^ 15 information is recorded to the corresponding fields in the picnic program 

information PRG_INF02 table. Each program contains one or more media 

objects. 

The field day program (PRGOOI) in this example contains three 
media objects as shown in Fig. 17. The first media object (MOV001) contains 
20 the opening ceremony for the field day, the second media object (MOV002} 
records the 100 meter dash, and the third media object (MOV003) records the 
closing ceremony. These three media objects can be created by the operating 
editing the content using the keypad on the input device 5, or they can be the 
originally recorded content. Field 53 in program information PRG_INF01 (Fig 
25 5) stores the value "3" to indicate that program 1 contains three media objects. 

Each media object contains a plurality of media object data units 
MODU. Each MODU normally starts with an l-frame as defined by the MPEG 
compression standard. More specifically, one media object data unit MODU 
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extends from the beginning of the l-frame to the picture immediately before 
the start of the next l-frame Fig. 17 shows MODU #1 to MODU #9, each 
MODU starting with an l-frame. This first l-frame is called the "entry frame." In 
other words, the entry frame is the starting frame of the MODU, is a frame at 
5 which the decoder can start decoding, and is normally an l-frame but can be a 
P-frame, The frames following the entry frame are P-frames or B-frames. Fig. 
rB 17 also shows entry frames El to E9. 

Time search entries TSE (that is, entry points) are also inserted 
at regular time intervals AT, every 5 seconds, for example, in the 
10 management information for each media object MOV as markers to make 
searching easier. This specific time interval AT determines the resolution of 
O the time search table. More specifically, each time search entry TSE is 

defined by the time search table recorded to field 81 in Fig. 8. As shown in 
O Fig. 8 the time search table contains information indicating the number of the 

15 MODU to which the time search entry is inserted, information indicating the 
number of frames from the time search entry to the immediately preceding 
entry frame, and the data offset indicating the amount of data from the start of 
the media object to the immediately preceding entry frame (that is, the 
number of bytes to that MODU). 
2 0 The example shown in Fig. 17 contains time search entries 

TSE1, TSE2, and TSE3. The time search table defining time search entry 
TSE1 stores MODU #3 as the MODU number, FN1 (=3) as the information 
indicating the number of frames from the time search entry point to the 
immediately preceding (last) entry frame, and data offset 0F3 as the amount 
25 of data from the beginning of the media object to the immediately preceding 
(last) entry frame. 

The time search table defining time search entry TSE2 stores 
MODU #5 as the MODU number, FN2 (=8) as the information indicating the 
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number of frames from the time search entry point to the immediately 
preceding entry frame, and data offset 0F5 as the amount of data from the 
beginning of the media object to the immediately preceding entry frame. 

The time search table defining time search entry TSE3 stores 
5 MODU #9 as the MODU number, FN3 (=4) as the information indicating the 
number of frames from the time search entry point to the immediately 
preceding entry frame, and data offset OF9 as the amount of data from the 
beginning of the media object to the immediately preceding entry frame. 

It will thus be apparent that if there are plural time search entries, 
10 the same plural number of time search entry tables is recorded to field 81 in 
Fig. 8. 

Random access play, fast-forward play, and fast-reverse play 
modes are executed as described below using a digital storage media 
configured as described above. 

15 Random access playback, that is, starting playback from some 

point between the beginning and end of a media object is described first. 
More specifically, this example describes playback from a playback start time 
PBT at 12 min 38 sec from the beginning of program 1 in Fig. 17 with 
reference to the flow chart in Fig. 18. The steps shown in Fig. 18 are 

20 executed by the controller 6. 

The program ID (number) and playback start time PBT are read 
at step S1. If playback is to start from the time at which playback was 
interrupted, the program ID and offset time recorded as the resume marker in 
field 31 of Fig. 3 are read as the program number and playback start time 

25 PBT. To play back a specific user-edited period, the program object ID and 
playback start time stored to playlist Information field 71 in Fig. 7 are read as 
the program number and playback start time PBT. Using the example shown 
in Fig. 17, program 1 and playback start time PBT = 12 minutes 38 seconds 



are read. 

The media object counter n is then reset to n = 1 in step S2. 

The playback time PTn for media object n is then read in step 
S3. This playback time PTn is stored to field 82 in Fig. 8. In the example 
shown in Fig. 17, the playback time of 12 minutes 30 seconds for the first 
media object 1 (MOVOOI) is thus read from field 82. 

The playback time PTn is then subtracted from the playback 
start time PBT, and the difference is stored as the new playback start time 
PBT in step S4. Using the example shown in Fig. 17. the result is 
12 m 38 s - 12 m 30 s = 8 s. 

Step S5 then determines if the new playback start time PBT 
obtained as this difference is less than zero. If the sign is positive, the 
procedure advances to step S6. 

The media object counter n is then incremented (step S6) so 
that n = 2 in this case, and steps S3, S4 and 85 repeat. 

This time step S4 calculates 
8 s- 10 m --9 m 52 s 
and step S5 therefore detects that PBT is negative (less than zero). The 
procedure thus advances to step S7 

Steps S3 to S6 thus detect the media object indicated by the 
playback start time by sequentially subtracting the playback time of each 
media object from the playback start time starting from the first media object, 
and comparing the resulting difference with the playback time of the next 
media object. 

The last-subtracted playback time PTn is then added to the last 
difference in step S7 so that the playback start time PBT is a positive value. 
In this example the playback start time PBT is 8 seconds. 

The final difference, that is, playback start time PBT, is then 



divided by the specific time interval AT, and the quotient q and remainder Tr 
are detected in step S8. As noted above, interval AT is 5 seconds in this 
example. Therefore, 

8 s / 5 s = 1 remainder 3 s 
Using the previously calculated difference and the specific time interval AT, 
steps S7 and S8 thus detect time search entry TSEq closest to the playback 
start time PBT in the media object and the remaining time Tr from that time 
search entry to the playback start time. 

The offset OFq and frame count FNq are then read from the 
time search table for the q-th time search entry TSEq (step S9). in this 
example offset OF3 and the frame count FN1 (=3) from the time search entry 
point to the immediately preceding entry frame are read from the time search 
table for time search entry TSE1 . 

The program is then accessed at offset OFq from the beginning 
of the program detected in step S1 (step S10). In this example the program is 
accessed at offset OF3 from the start of program 1 . 

The number of frames FNq determined in step S9 is then 
decoded and the program is accessed at time search entry TSEq (step S11). 
In this example three frames including entry frame E3 are decoded to access 
time search entry TSE1. Note that the frames are decoded at this time but are 
not presented on screen. 

A timer is then started in step S12. Note that decoding continues 
while the timer runs but the frames are not displayed. 

Whether the timer count Tm is greater than the remaining time 
Tr is then determined in step S13. Assume that the timer has counted to 3 
seconds in this example. 

The decoded content is then displayed on screen in step 314. 

It is thus possible to begin playback on screen from a desired 
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playback start time. 

Note that step S8 above divides the playback start time PBT by 
the specific time interval AT to obtain the quotient q and remainder Tr. 
Alternatively, however, the interval AT can be subtracted from the playback 
5 start time PBT with the subtraction loop repeating until the difference is a 
positive value smaller than the interval AT. In this case the number of 
subtraction operations determines quotient q and the remainder is Tr. 

Fast-forward and fast-reverse playback modes are described 
next with reference to the flow charts in Fig. 19, Fig. 20, and Fig. 21. The 
10 steps shown in Fig. 19, Fig. 20, and Fig. 21 are executed by the controller 6. 

First, the playback start time PBT specified by the resume 
marker is read in step S20. 

jhe time search entry TSEn immediately before the playback 
start time PBT is then detected (step S21). These steps S20 and S21 
15 accomplish the operations of steps S1 to S9 in Fig. 18. 

Offset OFn is then read from the time search table for time 
search entry TSEn and time search entry TSEn is accessed (step S22). 

Time search entry frame En is then decoded (step S23) and the 
decoded time search entry frame En is displayed (step S24). 
2 0 Whether fast-forward play (high speed playback in the normal 

(forward) direction) or fast-reverse play (high speed playback in the reverse 
direction) has been selected is then determined (step 825). If fast-forward 
play was selected, the procedure advances to step S26; if fast-reverse, the 
procedure goes to step S28. 
25 The next time search entry frame E(n+1 ) is detected in step S26, 

and the corresponding time search table is opened. This is described in detail 
with reference to Fig. 20. 

The specific time interval AT is then added to playback start time 
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PBT (step S27), and the procedure loops back to step S22. 

If fast-reverse play was selected then the previous time search 
entry frame E(n-1) is detected in step S28, and the corresponding time search 
table is opened. This is described in detail with reference to Fig. 21. 

The specific time interval AT is then subtracted from playback 
start time PBT (step S29). and the procedure loops back to step S22. 

Step S26 in Fig. 19 is described in detail with reference to the 
flow chart in Fig. 20. 

Decision diamond S30 determines if the management 
information for the currently accessed media object includes a table for 
identifying the next time search entry. If there is, the time search table for the 
next time search entry is opened. If not, control goes to step S31 . 

Step S31 determines if there is a next media object. If there is, 
the procedure advances to step S32; if not, control goes to step 833. 

Step S32 then opens the time search table for the first time 
search entry TSE in the identified media object. 

If there is not a next media object (step S31 returns no), step 
S33 determines if there is a next program. If there is not, the procedure ends. 
If there is, the procedure advances to step S34. 

The next program ID is then read in step S34, and the identified 
next program is accessed (step S35). 

Step S36 then opens the time search table for the first time 
search entry TSE of the first media object in the accessed program. 

If the time search table for a next time search entry TSE is 
successfully opened in step 830, 832, or S36, the procedure advances to 
step S27 in Fig. 19, time interval AT is added to the playback start time PBT, 
the entry frame En closest before the detected time search entry TSE is 
decoded, and the entry frame is displayed as a result of steps S22, S23, and 
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S24. 

Step 28 in Fig. 19 for fast-reverse play is described next with 
reference to the flow chart in Fig. 21 . 

Decision diamond S40 determines if the management 
5 information for the currently accessed media object includes a table for 
identifying the preceding time search entry. If there is, the time search table 
for the preceding time search entry is opened. If not, control goes to step S41 . 
Jjj Step S41 determines if there is a previous media object. If there 

J^l is, the procedure advances to step S42; if not, control goes to step S43. 

f ] 10 Step S42 then opens the time search table for the last time 

f ^ search entry TSE in the identified media object. 

Step S43 then determines if there is a preceding program. If not, 
tyj the procedure ends. If there is, the procedure advances to step S44. 

The preceding program ID is then read in step S44, and the 
15 identified preceding program is accessed (step S45). 

Step 846 then opens the time search table for the last time 
search entry TSE of the last media object in the accessed program. 

If the time search table for the preceding time search entry TSE 
is successfully opened in step S40, S42, or S46, the procedure advances to 
2 0 step S29 in Fig. 19, time interval AT is subtracted from the playback start time 
PBT, the entry frame En closest before the detected time search entry TSE is 
decoded, and the entry frame is displayed as a result of steps S22, S23, and 
S24. 

These operations are further described below. 
25 Multimedia content is recorded to this digital storage media 

according to the procedure shown in Fig. 10. 

As shown in Fig. 10, when the recording and playback system 2 
detects connection of a new digital storage medium 1, it creates a root 
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directory, management directory MGR_iNFO, and program manager file 
PRG_MGR in the digital storage medium 1, and initializes the DataType and 
other values. 

When the recording and playback system 2 then detects that the 
5 user has selected the recording mode, it checks all program numbers in the 
root directory to determine the new (next) program number nnn, and creates 
a program directory PRGnnn. The next program number nnn is typically 
^4 simply the highest existing program number +1, but if this number cannot be 

^ used then the next available program number is selected. If no program 

lO"; 10 number is available, a warning is issued to the user. 

jQi When the recording and playback system 2 detects that the user 

has pressed the record button, it compresses the video content input from the 
t^. camera 3 using the MPEG standard or other compression technique, records 

the compressed content as a media object data file MOV001.MOD in 
O 15 PRGnnn, and creates a media object information file MOV001 .MOI. 

When the user then stops recording, recording and playback 
system 2 stops recording media object data file MOV001.MOD, and writes the 
related information shown in Fig. 8 to the media object information file 
MOV001.MOI. A predetermined value is used for the time search table 
20 resolution Tstlntervai; MODU information MODUJNFO, entry count 
NumTstEntry 1 or 2, and the entry information (ModuNumber, EntryFrameDiff, 
ModuOffset) are determined with reference to the recorded MOV001.MOD file. 

If the user has selected still images to be reproduced 
simultaneously with the recorded video, the time-base relationship for still 
25 image playback is recorded to the scene descriptor data file SCN001 .SML. 

Next, the data size DataSize, playback time PlaybackDuration, 
number of media object information entries NumRefMoi, and media object 
information table RefMoiTbl are updated in the corresponding program 



information PRG_INFO in the program manager file PRG__MGR. 

The procedure described above is thereafter repeated while 
updating the media object data file number each time the user presses the 
record button. 

When the recording mode turns off, the size DataSize, total 
playback time PlaybackDuration, and program count NumPrglnfo are updated 
for the program manager file PRG_MGR. 

Editing a recorded program is described next with reference to 

Fig. 11. 

When the recording and playback system 2 detects that the user 
has selected an editing mode, it reads the program manager file PRG_MGR 
and the program information PRGJNFO therein to present a list of programs 
(including, for example, program titles, playback time, and representative 
images) recorded to the digital storage medium 1. 

If the user then selects the create new playlist information mode, 
a new playlist information PLSTJNFO table is added to the playlist manager 
file PLST_MGR, and the playlist information PLST_INFO header (including 
the type DataType and Attributes) is recorded as shown in Fig 7 

Next, if the user specifies the program number to play back and 
the playback start and end positions by time, this information is recorded as 
the playback program information entries program identifier ObjlD, playback 
start time StartPos, and playback end time EndPos in the playlist information 
PLSTJNFO. 

Playback program information for each subsequently selected 
program is similarly additionally recorded according to the playback start time 
and end time of the next user-selected program. 

Finally, when the user instructs playlist registration, the 
remaining playlist header information (size DataSize, creation lime 



CreateTime, playback time PlayBackDuration, number of program information 
entnes NumPrgTbl) is updated, and the size DataSize and playlist count 
NumPlstlnfo are updated in the playlist manager file PLST__MGR. 

If the user selects the mode for modifying an existing playlist 
information PLSTJNFO, the specified playlist information is displayed, and 
the program number, playback start time, and playback end time are modified 
according to the user instructions as described above. 

If the user selects a mode for deleting part of the content and 
the deletion range covers an entire program, the entire directory for that 
program is erased, the corresponding program information in the program 
manager file PRG_MGR is erased, and the size DataSize, playback time 
PlaybackDuration. program count NumPrglnfo, and other information related 
to the deleted program is updated in the program manager file PRG_MGR. 

Normal playback according to a playlist is described next with 

reference to Fig. 12. 

When the user selects a particular playlist and then presses the 
play button, the recording and playback system 2 sequentially reads the 
playback program information in the specified playlist information PLSTJNFO 
from the playlist manager file PLST_MGR. The recording and playback 
system 2 knows the playback program from the object identifier PrgID, 
sequentially reads the media object playback times from the medra object 
table RefMoiTbl written in the corresponding program information PRG„INFO 
table of the program manager file PRG_MGR. The recording and playback 
system 2 subtracts each read media object playback time from the program 
playback start time StartPos, and detects the number ppp of the media object 
information MOVppp,MOI at which the resulting difference first turns negative. 

Next, as shown in Fig. 15, the time resolution Tstlnterval value 
of the time search table in the media object information is repeatedly 
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subtracted from the difference of the immediately preceding playback start 
time StartPos to sequentially skip intervening entry points. Media object data 
MOVppp.MOD is then sequentially read and supplied to the MPEG decoder 
from the media object data unit position indicated by ModuOffset #n of entry 
5 point #n where the sign of the playback start time StartPos difference first 
becomes negative. If the frame count read from the MODU entry frame is 
equal to EntryFrameDiff, the playback time of the following frames is 
^ recalculated, and supplying the reproduced content to the display 4 starts 

when the calculated playback time is greater than or equal to the playback 
10 start time StartPos difference, 
fli If a SubObjID for an associated media object is specified in the 

media object information, that sub media object is reproduced instead of the 
H audio packet in media object data MOVppp.MOD. If a scene descriptor data 

t- SCNnnn.SML is included, the still image PICppp.JPG or text data 

O 15 TXTpppTXT specified therein is simultaneously reproduced as indicated. 

Playback continues while subtracting the total playback time to 
the read media object data position from the playback end time EndPos in the 
playlist, and reading stops when the playback end time EndPos difference 
becomes negative. 

20 The next program specified in the playlist information is 

reproduced next by repeating the above process. 

When playback of all programs in the playlist is completed, 
reading the media object data stops, and playback according to the selected 
playlist ends. 

25 A random access playback process is described next with 

reference to Fig. 13. 

When the user selects a playback start program, playback start 
time, and end time, and then presses the play button, the recording and 
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playback system 2 reads sequentially from the beginning of the media object 
ID table RefMoiTbl in the corresponding program information PRG_INFO 
table of the program manager file PRG_MGR, accumulates the playback 
times from media object information MOVnnn.MOi, and detects the first 
5 media object information MOVppp.MOl entry beyond the playback start time 
specified by the user. 

Next, the time search table resolution Tstlnterval of the current 
media object information MOVppp.MOl is repeatedly subtracted from the 
!Sl difference of the user-specified playback start time minus the total playback 

^5 10 time accumulated from the skipped media object information entries to 
1^ sequentially skip intervening entry points and find the entry frame where the 

^ difference from the user-specified playback start time first becomes negative, 

y Media object data MOVppp.MOD is then read sequentially from the 

m ModuOffset position of the MODU corresponding to the detected entry point 

it 15 and supplied to the MPEG decoder. As with playing a playlist as described 
above, output of the reproduced content starts when the total time of the 
frames read from the entry frame of that MODU is greater than the difference 
to the user-specified playback start time. 

If a SubObjID for an associated media object is specified in the 
20 media object information, that sub media object is reproduced instead of the 
audio packet in media object data MOVppp.MOD. If a scene descriptor data 
SCNnnn.SML is included, the still image PICppp.JPG or text data 
TXTpppTXT specified therein is simultaneously reproduced as indicated. 

Playback stops when the total playback time goes beyond the 
25 playback end time specified by the user 

Fast-forward play and fast-reverse play are described next with 
reference to Fig. 14. 

When the user presses the fast-forward or fast-reverse play 
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button, the recording and playback system 2 reads the program number 
specified by the ResumeMarker in the management data file MGR_DATA. 
Note that the ResumeMarker shown in Fig. 3 stores the time at which 
playback is interrupted. More specifically, the ResumeMarker stores which 
5 program was being played when playback was interrupted, and how much 
time had elapsed from the beginning of that program when playback was 
interrupted. The media object playback time written to field 54 of the media 
object information table RefMolTbi, which is written in the corresponding 
;S program information PRG„INFO (Fig. 5) in the program manager file 

Pi 10 PRG__MGR (Fig. 4), is subtracted from the resume playback time of the 

ifli ResumeMarker to detect the media object information MOVppp.MOl at which 

pj 

,5 the sign of the resume playback time of the ResumeMarker first becomes 

Jj negative. 

Next, as shown in Fig. 16, the last difference of the 
P: 15 ResumeMarker resume playback time is then divided by the time resolution 
Tstlnterval of the time search table in the current media object information 
MOVppp.MOl to detect the time search entry number #n Media object data 
MOVppp.MOD is then read from the ModuOffset position of the MODU at 
entry #n, supplied to the MPEG decoder, and output of the reproduced 

20 content starts. The #n-th media object unit information MODUJNFO is then 
read from the MODU information table ModuiTbl, reading shifts to the 
beginning of the next MODU entry frame when the number of bytes indicated 
by entry frame size EntrySize has been read, the amount of media object 
data MOVppp.MOD indicated by entry frame size EntrySize is read and 

25 supplied to the MPEG decoder, reading then skips to the next MODU, and 
this process simply repeats to continue fast-forward play until the end of the 
fast-forward play sequence is output. 

The same basic operation is used when the user selects fast- 
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reverse play except that after reproducing the first entry frame, reading skips 
to the preceding MODU to similarly play back the entry frame. This operation 
similarly repeats to the end of the fast-reverse sequence. 

When the user releases the fast-forward or fast-reverse button, 
the program ID and playback position are recorded to the ResumeMarker, 
and the fast-forward or fast-reverse play operation ends. 

As a result of the method described above, the playback method 
of the present invention can easily access a user-specified playback position. 
When the user selects a fast-forward, reverse play, or other trick play mode, 
the playback method of the invention can also easily read only the required 
data, and efficient trick play modes can be achieved. 

Although the present invention has been described in 
connection with the preferred embodiments thereof with reference to the 
accompanying drawings, it is to be noted that various changes and 
modifications will be apparent to those skilled in the art. Such changes and 
modifications are to be understood as included within the scope of the 
present invention as defined by the appended claims, unless they depart 
therefrom. 



